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METHOD AND APPARATUS FOR EXTRACTING MULTI- 
DIMENSIONAL STRUCTURES USING DYNAMIC 

CONSTRAINTS 

5 

BACKGROUND OF THE INVENTION 

The present invention relates generally to the field of medical imaging. 
Specifically, the invention relates to a technique for automatically extracting 
structures, particularly three-dimensional structures, from a voliune dataset. 

10 

A volume dataset may be generated by a variety of medical imaging 
technologies or modalities. For example, magnetic resonance imaging (MRI) modalities 
generate volume datasets by exposing a patient to magnetic field and by measuring the 
response and realignment of various magnetically susceptible molecule types within the 

15 body. By imposing weak gradient fields along the three-dimensional axes during the 

process, positional information may be obtained which allows a volume dataset to be 
constmcted. Other technologies, such computed tomography (CT), measure the 
attenuation of streams of radiation through the body fi-om numerous angles. The 
attenuation information may be combined and reconstructed to generate a volume 

20 dataset. Still other imaging modalities, such as various nuclear imaging technologies, 

measure the detectable emissions generated by labeled molecules, such as radionuclides 
or radiopharmaceuticals, to provide volume data. Though the manner in which a 
volume dataset is created may vary, with the above techniques representing only a 
sample, the analysis of volume datasets raise many common issues. 

25 

For instance, it is often desirable to segment and extract image data 
corresponding to contiguous and/or complex structures firom the background volume for 
analysis. For example, in the field of CT angiography (CTA), the vascular and other 
circulatory system structures may be imaged, typically by administration of a radio- 
30 opaque dye prior to imaging. Visualization of the CTA data typically is performed in a 

two-dimensional manner, i.e., slice-by-slice, or in a three-dimensional manner, i.e., 

1 
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volume visualization, which allows the data to be analyzed for vascular pathologies. 
For example, the data may be analyzed for aneurysms, vascular calcification, renal 
donor assessment, stent placement, vascular blockage, and vascular evaluation for sizing 
and/or runoff. Once a pathology is located, quantitative assessments of the pathology 
may be made of the on the original two-dimensional slices. 

As one might expect, segmentation and extraction of complex structures, such as 
the vasculature in the preceding CTA example, may benefit from accurate segmentation, 
i.e., identification, of the image data corresponding to the structure of interest. 
Similarly, quantitative assessment of located pathologies, as noted above, may also 
benefit from accurate segmentation. Existing segmentation techniques, however, may 
incorrectly incorporate background or proximate objects into the segmented structure 
due to poor recognition of edges or non-homogeneities in the image data. Similarly, 
existing techniques may hnproperly exclude image data from the segmented structure 
due to poor edge recognition and/or non-homogeneities. Such exclusions may 
potentially result in early or erroneous termination of the segmentation technique. 
Furthermore, splits or mergers in the structure of interest may not be properly segmented 
by existing techniques due to these shortcomings. In addition, anatomic and 
pathological variabihty within the patient population, such as due to plaque deposits in 
the vasculature or to the presence of interventional devices, such as stents, may fiirther 
confoxmd the segmentation process. 

For example, in CTA, overlapping image intensities, close proximity of imaged 
structures, and limited detector resolution may make the automated separation of bone 
and vascular structures difficult. In particular, the proximity of vascular structures and 
bone in the head and neck region, along the vertebra and near the pelvis make 
segmentation an exceedingly complex task for computer-based algorithms. The 
presence of calcification or interventional devices may compound these difficulties. 
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As a result, proper segmentation of a complex or contiguous three-dimensional 
structure, such as the vasculature around the head and neck region, may require operator 
intervention or input. In particular, operator intervention may be needed to designate 
initial start points and/or to prevent the inadvertent inclusion or exclusions of volume 
data from the segmented structure. This operator intervention can lead to imdesirable 
delays as well as to inter- and intra- user variability in the segmentation of structures. 
There is a need therefore, for an improved technique for segmenting structure in a 
volume, preferably with Uttle or no human intervention. 

BRIEF DESCRIPTION OF THE INVENTION 

The present technique provides a novel approach to automatically segmenting 
a structure of interest in a volume data set. Automatic initialization may be performed 
to identify one or more initiation regions in the image data based upon templates that 
characterize properties of the structure of interest. The identified regions serve as 
starting points for the subsequent constrained growth process. Edge boundaries may 
be computed based on gradient data obtained by comparing each voxel to all adjacent 
voxels and assigning the maximum absolute gradient value as the gradient for the 
pixel. Constrained path finding may then be employed using the edge data and the 
initiation regions, as well as cross-sectional areas for regions in the image data. The 
constrained path finding process may employ dynamic constraints which are modified 
based upon local statistics, allowing candidate pixels to be selectively merged into the 
foreground region. The process may be iterated imtil the supply of candidate pixels is 
exhausted. The resulting volume comprises the segmented structure of interest. 

In accordance with a first aspect of the technique, a method for determining 
edge voxels is provided. According to this aspect, a gradient for each of a plurality of 
voxels is calculated by determining a maximum absolute gradient component relative 
to each adjacent voxel. One or more edge voxels from the plurality of voxels is 
identified based upon a comparison of the gradients of each of the plurality of voxels 
to a threshold edge gradient. Systems and computer programs that afford 
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functionality of the type defined by such methods are also provided by the present 
technique. 

In accordance with another aspect of the present technique, a method for 
segmenting a structure is provided. According to this aspect, one or more candidate 
voxels are iteratively merged into a foreground region comprising at least one or more 
seed voxels. The candidate voxels are merged based on one or more dynamic 
constraints. The merged candidate voxels become the seed voxels for the next iteration. 
A queue of candidate voxels is iteratively updated each iteration based upon the new 
seed voxels. The iterative processes are terminated to generate a segmented structure 
comprising the foregroxmd region. Systems and computer programs that afford 
functionality of the type defined by such methods are also provided by the present 
technique. 

In accordance with a further aspect of the present technique, a method for 
identifying a structure of interest is provided. According to this aspect, at least one of 
a geometrical template and a functional template is provided. Each template 
represents at least one characteristic of a structure of interest. One or more regions of 
the structure of interest are identified based upon the similarity of the respective 
characteristic in the regions and the provided templates. Systems and computer 
programs that afford functionality of the type defined by such methods are also 
provided by the present technique. 

In accordance with an additional aspect of the present technique, a method for 
automatically segmenting a structure fi"om a set of image data is provided. According 
to this aspect, one or more initial regions corresponding to a structure of interest are 
selected firom a volume data set. An edge map is generated fi-om the volume data set. 
The structure of interest is iteratively segmented using at least the one or more initial 
regions and the edge map. The segmentation is based upon one or more dynamic 
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constraints. Systems and computer programs that afford fiinctionality of the type 
defined by such methods are also provided by the present technique. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other advantages and features of the invention will become 
apparent upon reading the following detailed description and upon reference to the 
drawings in which: 

Fig. 1 is a general diagrammatical representation of certain functional 
components of an exemplary generic imaging system configured for remote operation 
via the present technique; 

Fig. 2 is a flowchart depicting a technique for dynamically segmenting a 
structure firom a volimie data set, in accordance with the present technique; 

Fig. 3 is a flowchart depicting a technique for calculating an edge map, in 
accordance with the present technique; and 

Fig. 4 is a flowchart depicting a technique for dynamically growing a 
segmented structure fi"om a set of seed voxels, in accordance with the present 
technique. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 

Turning now to the drawings, and referring first to Fig. 1, an exemplary 
imaging system 10 suitable for use in a medical context is depicted. Generally, the 
imaging system 10 includes some type of imager 12 that may operate in accordance 
with various physical principles for creating image data. In general, the imager 12 
creates image data representative of regions of interest in a patient 14 in a digital 
medium. As will be appreciated by one of ordinary skill in the art, the imaging 
system 10 may comprise a computer tomography (CT), a magnetic resonance (MR), a 
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positron emission tomography (PET), an electron beam tomography (EBT) or other 
modality of imaging system capable of generating a volume data set. 

The imager 12 operates under the control of system control circuitry 16. The 
5 system control circuitry 16 may include a wide range of circuits, such as radiation 

source control circuits, timing circuits, circuits for coordinating data acquisition in 
conjunction with patient or table movements, circuits for controlling the position of 
radiation sources and detectors, and so forth. In the present context, the system 
control circuitry 16 may also include memory elements for storing programs and 
10 routines implementing the techniques described herein which may be executed by the 

system control circuitry 16 or by associated components of the imaging system 10. 

The imager 12, following acquisition of the image data or signals, may process 
the signals, such £is for conversion to digital values, and forward the image data to 

15 data acquisition circuitry 18. For digital systems, the data acquisition circuitry 18 

may perform a wide range of initial processing functions, such as adjustment of digital 
dynamic ranges, smoothing or sharpening of data, as well as compiling of data 
streams and files, where desired. The data may then be transferred to data processing 
circuitry 20 where additional processing and analysis are performed. For the various 

20 digital imaging systems available, the data processing circuitry 20 perform substantial 

analyses of data, ordering of data, sharpening, smoothing, feature recognition, and so 
forth, which facilitate the generation of a useful set of image data. The data 
processing functions may be performed, in general, under the guidance of one or more 
technologists. The acquired images or image data may be stored in short or long-term 

25 storage devices, such as a picture archiving communication system (PACS) that may 

be accessible locally or over a network. 

The above-described operations and functions of the imaging system 10 may 
be controlled by a scanner console 24, which typically interfaces with the system 
30 control circuitry 16. The scanner console 24 may include one or more general 
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purpose or application specific computers 30 or processor-based components. The 
scanner console 24 may include a monitor 32 or other visual display and one or more 
input devices 34. The monitor 32 and input devices 34 may be used for viewing and 
inputting configuration information or for operating aspects of the imaging system 10, 
in accordance with the techniques discussed herein. As with the system control 
circuitry 16, the scanner console 24 may comprise or communicate with a memory or 
data storage component for storing programs and routines implementing the 
techniques described herein. Moreover, the memory or storage component may 
comprise one or more memory devices, such as magnetic or optical drives, of similar 
or different types, which may be local or remote fi*om one another. 

The scanner console 24 may be coupled to a picture archiving and 
commimications system (PACS). The PACS may be coupled to a remote console, 
radiology department information system (RIS), hospital information system (HIS) or to 
an internal or external network, so that others at different locations may gain access to 
the image and to the image data. Furthermore, more than one scanner console 24 may 
be provided locally. For example, an imaging scanner or station may include a 
console which permits regulation of the parameters involved in the image data 
acquisition procedure, whereas a different scaimer console may be provided for 
manipulating, enhancing, and viewing resulting reconstmcted images. 

As noted above, the scaimer console 24 may include one or more computers 
as well as a monitor 32, allowing images and/or volumes generated fi-om the acquired 
data to be displayed. These images and/or volumes typically depict intemal features 
of a patient for review and analysis by a technologist or radiologist. To facilitate the 
review and analysis process, segmentation and extraction of one or more structures of 
interest may be performed and the extracted structure subsequently displayed. 

In structure segmentation, the discrete visualization elements, such as pixels in 
a two-dimensional image or voxels in a three-dimensional volume, associated with a 
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structure of interest are identified. Once identified, the segmented structure may be 
extracted and displayed in two-dimensions or visualized in three-dimensions separate 
from the background image data. Altematively, the segmented structure may be 
masked, i.e., subtracted from the image data set, allowing an image or volume to be 
reconstructed without the segmented stmcture, which may facilitate the viewing of 
underlying structures. 

Segmentation, however, may be problematic when the image intensities of the 
structure of interest overlap with the background image intensities, making 
identification of the structure edges problematic. In addition, non-homogeneities 
within the structure or background may make accurate identification and selection of 
structure voxels or voxels difficult. These non-homogeneities may include anatomic 
or pathologic variability within the patient, such as calcifications or interventional 
devices, such as stents, in the vasculature. Because of these problems, a technologist 
may need to initiate aspects of the segmentation process, such as by initially selecting 
stmcture starting points, or intervene to prevent early termination of segmentation or 
improper inclusion or exclusion of background elements into the stmcture of interest. 
However, because of the amount of data that must be examined to identify the 
stmcture components, typically 150 - 1,500 slices for CTA data, it is highly desirable 
to minimize human involvement in the segmentation process, both for time and 
workload reasons. 

One technique that may be employed for segmenting stmcture with reduced or 
no human intervention is depicted in Fig. 2. The technique depicted in Fig. 2 is 
modality independent and is therefore applicable to the segmentation of stmctures 
within volumes generated by a variety of modalities, including CT, MR, PET, EBT, 
and so forth. For the sake of simplicity, the technique is discussed in the context of 
CTA, however, as one of ordinary skill in the art will appreciate, the technique may be 
applied to other modalities and other structures. 
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In the context of a CTA example, the volume dataset 40 may be a 
reconstructed stack of axial slices, typically formatted in the Digital Imaging and 
Communications In Medicine (DICOM) standard. The in-plane resolution of the data 
varies may be between 0.55 mm and 0.88 mm with a reconstructed slice thickness 
5 range of 1,25 mm to 2.0 mm, though other in-plane and in-z resolutions are possible. 

The image resolutions in each of the three dimensions may be recorded to help in 
monitoring and assessing information about structures in an exact physical measure. 
The image intensities associated with each slice may conform to a standard 16-bit 
brightness value. 

10 

An automatic initialization step 42 may be performed on the volume of 
interest to generate initial or seed points for three-dimensional structure tracking. In 
particular, the automatic initialization step 42 locates three-dimensional structures of 
interest in the volume 40 without manual input. The automatic initialization step 42 

15 may identify the three-dimensional objects using simple or fundamental two- 

dimensional or three-dimensional geometric representations such as cross sections, 
projections, and so forth, and/or using functional models such as intensity distribution, 
intensity level, pattern, and so forth. By using geometrical and functional templates, 
the automatic initiahzation algorithm may be generalized to identify three- 

20 dimensional structures of interest from any volimie dataset, regardless of the 

underlying imaging modality. 

A template database 44 may provide templates to the automatic initialization 
step 42. The template database 44 may contain various templates based on objects of 

25 interest and the possible intensity distributions of such objects. Each template is a 

basic representation of an object that captures geometric and/or functional 
characteristics of the object. For example, in the CTA context the structure of interest 
is the three-dimensional vascular network, which is comprised of essentially tubular 
components. A suitable geometrical template for vasculature, therefore, may include 

30 a round template model since blood vessel cross-sections are generally circular in 
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axial, coronal, sagittal, or arbitrary oblique planes of a dataset. Similarly, a suitable 
functional template for vasculature may include low standard deviations of intensities 
or some other statistical homogeneity criteria, since radio-opaque dyes or contrast 
agents used for CTA typically provide uniform X-ray attenuation. If desired, 
customized template models can be created for objects of interest depending on the 
application. In the CTA example, therefore, a template driven automatic initialization 
step 42 may be used to locate regions of the volume dataset 40 that substantially 
match the template characteristics, i.e., round regions having uniform intensity. These 
located regions indicate regions of vasculature, i.e., the structure of interest, and serve 
as potential starting or seed points for further structure identification and 
segmentation. 

In addition to the starting points, the edges of the structure of interest may be 
determined such as by locating areas or regions with strong intensity contrast. The 
edge locations may be used to generate an edge map, as depicted at step 46, indicative 
of object boundaries within the image data. For example, gradient edge detection is 
often used to detect object boundaries, since edges correspond to strong illumination 
gradients. In the present technique, as depicted in Fig. 3, the gradient at a voxel may 
be calculated at step 48 by finding the maximum absolute gradient component of the 
voxel relative to the twenty-six adjacent voxels. Determining the gradient for each 
voxel relative to each of the twenty-six adjacent voxels allows weak boimdaries, 
which might otherwise be missed, to be detected. 

Once the gradient of each voxel is determined, a gradient image 50 may be 
generated which represents the gradient associated with each voxel. A threshold, 
which may be provided by the operator or statistically determined from the image 
data, may be applied at step 52 to determine which voxels constitute edge voxels 
based upon their corresponding gradient values. An edge map 54 may be generated 
depicting the edge voxels. The edge map 54 prevents subsequent structure 



10 



140314-1 



identification and segmentation algorithms fi-om erroneously including voxels fi-om 
backgrovmd regions and adjacent objects in the segmented structure. 

The next step in segmentation is a dynamic path finding step 58, described in 
greater detail in Fig. 4, which extracts three-dimensional structures of interest fi-om 
the volimie dataset 40 starting fi-om the seed voxels computed by the automatic 
initialization step 42. The dynamic path finding step may take the edge map 46, the 
seed voxels, and the cross sectional sizes of the identified regions, computed at step 
56, as inputs for constrained region growing. The dynamic path finding operation is 
typically an iterative process in which the regions identified by automatic 
initiaUzation comprise the original seed voxels 60 that form the initial foregroxmd 
region. The foreground region is iteratively grown in all the directions to extend the 
region in three-dimensions. 

All voxels connected to the seed voxels 60 comprise a queue of candidate 
voxels 64. The candidate voxels are merged with the foreground region, as depicted 
at step 62, if the candidate voxels meet the desired constraint, such as a desired 
homogeneity criterion. Candidate voxel which are merged with the growing region 
become the new seed voxels 60 and the candidate voxel queue is updated to reflect the 
latest set of connected voxels, as depicted at step 66. Region growing may be 
continued a configured number of iterations or until the candidate voxels queue is 
emptied, as determined at decision block 68, or substantially emptied. Once region 
growing is terminated, the merged voxels comprise the segmented structure 70. 

As noted above, the growing process may be dynamically altered. In 
particular, the constraint, used in the path finding step 58 may be dynamically altered 
based on anatomy or local statistics of the three-dimensional structure. In this 
manner, the constraint may be modified to allow the path finding process to properly 
segment non-homogeneous three-dimensional stmctures. Path tracking, therefore, 
may be altered based on the anatomy of the structure. 
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For example, the constraints used for path finding may be dynamically 
changed based on size of the cross section and local statistics of the region. In 
particular, the size of the cross section of each region, as determined at step 56, may 
indicate whether the region is isolated from the background object or coimected with 
the backgroimd structures. Sudden change in size of the cross section may indicate 
merging and splitting of the three-dimensional structures in the volume dataset 40. 
For example, in the case of CTA, a region size less than 30 mm^ suggests that the 
cross-section of the three-dimensional vascular structure is isolated from the 
background structures. Constraints on region growing may therefore be relaxed for 
candidate voxels associated with these regions. A region size greater than 30 mm^ 
suggests that the cross section of the three-dimensional vascular structure is coimected 
with the background stmctures, such as bone. Constraints on the region growing may 
therefore be tightened for candidate voxels associated with these regions. The edge 
map 54 prevents the region growing process growing into connected non-vascular 
structures. 

The constrained growth of the foreground region may be demonstrated by the 
following possible rules: 

1. If a candidate voxel belongs to a region that is smaller than a low size 
threshold (STg^jj), the candidate voxel may be merged with the foreground region, 
i.e., the segmented structure, if its intensity lies between a low intensity threshold 
(T,o J and a high intensity threshold (T^^^y), The thresholds Ty^^ and T^igh represent the 
range of the intensity distribution of the foreground region. The various thresholds 
may be calculated from the initial starting points, i.e., seed voxels 60. If a candidate 
voxel is merged with the foreground region, unmerged voxels connected to the 
merged voxel are added to the candidate voxel queue 64 for the next iteration of 
constrained growth. 
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2. If a candidate voxel belongs to a region that is larger than ST^^j,, the 
candidate voxel may be merged with the foreground region if the intensity difference 
between the candidate point and the connected voxel in the foreground region is less 
than 0.6*0^. The standard deviation represents the standard deviation of the 
classified voxels in a local cube of size n*n*n around the seed voxels 60. The initial 
value of Ga is calculated fi-om the starting seed voxels 60, prior to iterative growth. If 
a candidate voxel is merged with the foreground region, unmerged voxels connected 
to the merged voxel are added to the candidate voxel queue 64 for the next iteration of 
constrained growth. 

As noted above, during the iterative process, voxels classified as structure in 
one iteration, i.e., merged voxels, become the seed voxels 60 for the next iteration. At 
the end of each iteration, may be updated to revise the local statistics of the region. 
The adaptive parameter is calculated in a local cube of dimension n*n*n around the 
seed voxels 60. The variable n is typically a whole number between 1 and 10, for 
example, n may equal 6 in a typical CTA application. By dynamically constraining 
growth based upon the iteratively updated parameter the tracking of non- 
homogeneous structures may be enhanced. 

As will be appreciated by those of ordinary skill in the art, the preceding 
examples represent but one set of possible rules which allow for dynamic 
modification of the of the constrained growth process. The rules may be modified or 
other rules developed to customize the rules to specific anatomical regions based upon 
the characteristic and properties of the anatomical region. Similarly, the rules may be 
modified or other rules developed based on the modality employed to generate the 
volume dataset 40. 

The present technique may be implemented as one or more computationally 
eflRcient routines, allowing for the automatic segmentation of structure in a volume 
dataset. Due to the automated nature and computational efficiency of the 
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segmentation process, the segmented structure may be obtained in a near-real time, or 
a real time manner. Likewise, the robustness of the technique makes it useful for 
processing any data sets regardless of the presence or absence of pathologies or of the 
imaging modality used to generate the volume dataset 40. 

The segmented structure 70, once obtained may be extracted and viewed 
separately from the background image data or masked to improve the view of the 
background image data. Alternatively, the segmented structure 70 may be visualized 
at varying degrees of opacity and translucence, such that the technologist may fade the 
segmented structure 70 in and out of the volume rendering. In this manner, the 
technologist may use the presence of the segmented structure 70 to provide orientation 
and location information. Once oriented, however, the segmented structure 70 may be 
excluded to examine other structures or background. In addition to configuring the 
translucence or opacity of the mask, the technologist may be provided with the ability 
to increase or decrease the intensity of the segmented structure in an image or volume, 
in order to generate the desired rendering. 

While the invention may be susceptible to various modifications and 
alternative forms, specific embodiments have been shown by way of example in the 
drawings and have been described in detail herein. However, it should be understood 
that the invention is not intended to be limited to the particular forms disclosed. 
Rather, the invention is to cover all modifications, equivalents, and alternatives falling 
within the spirit and scope of the invention as defined by the following appended 
claims. 
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